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(57) A code excited linear predictive coder and decoder well suited to speech recording, transmission and 
reproduction, especially in voice messaging systems, provides backward adaptive gain control of stored 
codevectors to be applied to a synthesis filter prior to being compared with sequences of input speech 
signals. Simplified linear predictive parameter quantization using efficient table lookup procedures, 
efficient codevector storage and search all contribute in an illustrative embodiment to high quality 
coding and decoding with reduced computational complexity. 
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Cross- Reference to Related Application 

An application entitled "Voice Message Synchronization" by David O. Anderton filed of even date herewith 
is related to the subject matter of the present application. 

5 

Field of the Invention 

This invention relates to voice coding and decoding. More particularly this invention relates to digital coding 
of voice signals for storage and transmission, and to decoding of digital signals to reproduce voice signals. 

10 

Background of the Invention 

Recent advances in speech coding coupled with a dramatic increase in the performance- to- price ratio for 
Digital Signal Processor (DSP) devices have significantly improved the perceptual quality of compressed 

15 speech in speech processing systems such as voice store- and-forward systems or voice messaging systems. 
Typical applications of such voice processing systems are described in S. Rangnekar and M. Hossain, "AT&T 
Voice Mail Service," AT&T Technology, Vol. 5, No. 4, 1990 and in A. Ramirez, "From the Voice-Mail Acorn, a 
Still-Spreading Oak," NY Times, May 3, 1 992. 

Speech coders used in voice messaging systems provide speech compression for reducing the number 

20 of bits required to represent a voice waveform. Speech coding finds application in voice messaging by reducing 
the number of bits that must be used to transmit a voice message to a distant location or to reduce the number 
of bits that must be stored to recover a voice message at some future time. Decoders in such systems provide 
the complementary function of expanding stored or transmitted coded voice signals in such manner as to permit 
reproduction of the original voice signals. 

25 Salient attributes of a speech coder optimized for transmission include low bit rate, high perceptual quality, 

low delay, robustness to multiple encodings (tandeming), robustness to bit-errors, and low cost of implemen- 
tation. A coder optimized for voice messaging, on the other hand, advantageously emphasizes the same low 
bit rate, high perceptual quality, robustness to multiple encodings (tandeming) and low cost of implementation, 
but also provides resilience to mixed-encodings (transcoding). 

30 These differences arise because, in voice messaging, speech is encoded and stored using mass storage 

media for recovery at a later time. Delays of up to a few hundred milliseconds in encoding or decoding are un- 
observable to a voice messaging system user. Such large delays in transmission applications, on the other 
hand, can cause major difficulties for echo cancellation and disrupt the natural give-and-take of two-way real 
time conversations. Furthermore, the high reliability of mass storage media achieve bit error rates several or- 

35 ders of magnitude lower than those observed on many contemporary transmission facilities. Hence, robust- 
ness to bit errors is not a primary concern for voice messaging systems. 

Prior art systems for voice storage typically employ the CCITT G.721 standard 32 kb/s ADPCM speech 
coder or a 16 kbit/s Sub-Band coder (SBC) as described in J.G. Josenhans, J.F. Lynch, Jr., M.R. Rogers, R.R. 
Rosinski, and W.P. VanDame, "Report: Speech Processing Application Standards," AT&T Technical Journal, 

40 Vol. 65, No. 5, Sep/Oct 1986, pp. 23-33. More generalized aspects of SBC are described, e.g., in N.S. Jayant 
and P. Noll, "Digital Coding of Waveforms - Principles and Applications to Speech and Video", and in U.S. Patent 
4,048,443 issued to R. E. Crochiere et al. on Sept. 13, 1977. 

While 32 kb/s ADPCM gives very good speech quality, its bit-rate is higher than desired. On the other hand, 
while 16 kbit/s SBC has half the bit-rate and has offered a reasonable tradeoff between cost and performance 

45 in prior art systems, recent advances in speech coding and DSP technology have rendered SBC less than op- 
timum for many current applications. In particular, new speech coders are often superior to SBC in terms of 
perceptual quality and tandeming/transcoding performance. Such new coders are typified by so-called code 
excited linear predictive coders (CELP) disclosed, e.g., in U.S. Patent Application Ser. No. 07/298451, by J-H 
Chen, filed January 17, 1 959, now abandoned, and U.S. Patent Application Ser. No. 07/757,168 by J-H. Chen, 

so filed Sept. 10, 1991, U.S. Patent Application Ser. No. 07/837,509 by J-H. Chen etal., filed Feb. 18, 1992, and 
U.S. Patent Application Ser. No. 07/837,522 by J-H. Chen et al., filed Feb. 18, 1992, assigned to the assignee 
of the present application. Each of these applications are hereby incorporated by reference in the present ap- 
plication as if set forth in their entirety herein. Related coders and decoders are described in J-H Chen, "A 
robust low-delay CELP speech coder at 16 kbit/s," Proc. GLOBECOM, pp. 1237-1241 (Nov. 1989); J-H Chen, 

55 "High-quality 16 kb/s speech coding with a one-way delay less than 2 ms ," Proc. ICASSP, pp. 453456 (April 
1990); J-H Chen, M.J. Melchner, R.V. Cox and D.O. Bowker, "Real-time implementation of a 16 kb/s low-delay 
CELP speech coder," Proc. ICASSP, pp. 181-184 (April 1 990); all of which papers are hereby incorporated here- 
in by reference as if set forth in their entirety. Afurther description of the candidate 16 kbit/sec LD CELP stan- 
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dard system was presented in a document entitled "Draft Recommendation on 16 kbit/s Voice Coding/ (here- 
inafter the Draft CCITT Standard Document) submitted to the CCITT Study Group XV in its meeting in Geneva, 
Switzerland during November 11-22, 1991 which document is incorporated herein by reference in its entirety. 
5 In the sequel, systems of the type described in the Draft CCITT Standard Document will be referred to as LD- 
CELP systems. 

Summary of the Invention 

10 Voice storage and transmission systems, including voice messaging systems, employing typical embodi- 

ments of the present invention achieve significant gains in perceptual quality and cost relative to prior art voice 
processing systems. Although some embodiments of the present invention are especially adapted for voice 
storage applications and therefore are to be contrasted with systems primarily adapted for use in conformance 
to the CCITT (transmission-optimized) standard, embodiments of the present invention will nevertheless find 

15 application in appropriate transmission applications. 

Typical embodiments of the present invention are known as Voice Messaging Coders and will be referred 
to, whether in the singular or plural, as VMC. In an illustrative 16 kbit/s embodiment, a VMC provides speech 
quality comparable to 16 kbit/s LD-CELP or 32 kbit/s ADPCM (CCITT G.721) and provides good performance 
under tandem encodings. Further, VMC minimizes degradation for mixed encodings (transcoding) with other 

20 speech coders used in the voice messaging or voice mail industry (e.g., ADPCM, CVSD, etc.). Importantly, a 
plurality of encoder-decoder pair implementations of 16 kb/sec VMC algorithms can be implemented using a 
single AT&T DSP32C processor under program control. 

VMC has many features in common with the recently adopted CCITT standard 16 kbit/s Low-Delay CELP 
coder (CCITT Recommendation G.728) described in the Draft CCITT Standard Document However, in ach- 

25 ieving its desired goals, VMC advantageously uses forward-adaptive LPC analysis as opposed to backwards- 
adaptive LPC analysis typically used in LD-CELP. Additionally, typical embodiments of VMC advantageously 
use a lower order (typically 1 0th order) LPC model, rather than a 50th order model for LD-CELP. VMC typically 
incorporates a 3-tap pitch predictor rather than the one-tap predictor used in conventional CELP. VMC uses 
a first order backwards-adaptive gain predictor as opposed to a 10th order predictor for LD-CELP. VMC also 

30 advantageously quantizes the gain predictor for greater stability and interoperability with implementations on 
different hardware platforms. In illustrative embodiments, VMC uses an excitation vector dimension of 4 rather 
than 5 as used in LD-CELP, thereby to achieve important computational complexity advantages. Furthermore 
VMC illustratively uses a 6-bit gain-shape excitation codebook, with 5-bits allocated to shape and 1-bit allo- 
cated to gain. LD-CELP, by contrast, uses a 10- bit gain-shape codebook with 7-bits allocated to shape and 3- 

35 bits allocated to gain. 

Brief Description of the Drawings 

FIG. 1 is an overall block diagram of a typical embodiment of a coder/decoder pair in accordance with one 
40 aspect of the present invention. 

FIG. 2 is a more detailed block diagram of a coder of the type shown in FIG. 1 . 
FIG. 3 is a more detailed block diagram of a decoder of the type shown in FIG. 2. 
FIG. 4 is a flow chart of operations performed in the illustrative system of FIG. 1 . 

FIG. 5 is a more detailed block diagram of the predictor analysis and quantization elements of the system 
45 of FIG. 1. 

FIG. 6 shows an illustrative backward gain adaptor for use in the typical embodiment of FIG. 1. 
FIG. 7 shows a typical format for encoded excitation information (gain and shape) used in the embodiment 
of FIG. 1. 

FIG. 8 illustrates a typical packing order for a compressed data frame used in coding and decoding in the 
so illustrative system of FIG. 1. 

FIG. 9 illustrates one data frame (48 bytes) illustratively used in the system of FIG. 1. 

FIG. 10 is an encoder state control diagram useful in understanding aspects of the operation of the coder 
in the illustrative system of FIG. 1. 

FIG. 11 is a decoder state control diagram useful in understanding aspects of the operation of the decoder 
55 in the illustrative system of FIG. 1. 
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Detailed Description 
1. Outline of VMC 

5 

The VMC shown in an illustrative embodiment in FIG. 1 is a predictive coder specially designed to achieve 
high speech quality at 16 kblt/s with moderate coder complexity. This coder produces synthesized speech on 
lead 100 in FIG. 1 by passing an excitation sequence from excitation code book 101 through a gain scaler 102 
then through a long-term synthesis filter 103 and a short-term synthesis filter 104. Both synthesis filters are 

10 adaptive all-pole filters containing, respectively, a long-term predictor or a short-term predictor in a feedback 
loop, as shown in FIG. 1 . The VMC encodes input speech samples in frame-by-frame fashion as they are input 
on lead 110. For each frame, VMC attempts to find the best predictors, gains, and excitation such that a per- 
ceptually weighted mean-squared error between the input speech on input 110 and the synthesized speech 
is minimized. The error is determined in comparator 115 and weighted in perceptual weighting filter 120. The 

15 minimization is determined as indicated by block 125 based on results for the excitation vectors in code book 
101. 

The long-term predictor 103 is illustratively a 3-tap predictor with a bulk delay which, for voiced speech, 
corresponds to the fundamental pitch period or a multiple of it For this reason, this bulk delay is sometimes 
referred to as the pitch lag. Such a long-term predictor is often referred to as a pitch predictor, because its 

20 main function is to exploit the pitch periodicity in voiced speech. The short-term predictor is 104 is illustratively 
a 10th- order predictor. It is sometimes referred to as the LPC predictor, because it was first used in the well- 
known LPC (Linear Predictive Coding) vocoders that typically operate at 2.4 kbit/s or below. 

The long-term and short-term predictors are each updated at a fixed rate in respective analysis and quan- 
tization elements 130 and 135. At each update, the new predictor parameters are encoded and, after being 

25 multiplexed and coded in element 1 37, are transmitted to channel/storage element 140. For ease of description, 
the term transmit will be used to mean either (1) transmitting a bit-stream through a communication channel 
to the decoder, or (2) storing a bit-stream in a storage medium (e.g., a computer disk) for later retrieval by the 
decoder. In contrast with updating of parameters for filters 103 and 104, the excitation gain provided by gain 
element 102 is updated in backward gain adapter 145 by using the gain information embedded in previously 

30 quantized excitation; thus there is no need to encode and transmit the gain information. 

The excitation Vector Quantization (VQ) codebook 101 illustratively contains a table of 32 linearly inde- 
pendent codebook vectors (or codevectors), each having 4 components. With an additional bit that determines 
the sign of each of the 32 excitation codevectors, the codebook 101 provides the equivalent of 64 codevectors 
that serve as candidates for each 4-sample excitation vector. Hence, a total of 6 bits are used to specify each 

35 quantized excitation vector. The excitation information, therefore, is encoded at 6/4 =1.5 bits/samples =12 
kbit/s (8 kHz sampling is illustratively assumed). The long-term and short-term predictor information (also 
called side information) is encoded at a rate of 0.5 bits/sample or 4 kbit/s. Thus the total bit-rate is 16 kbit/s. 
An illustrative data organization for the coder of FIG. 1 will now be described. 

After the conversion from u-law PCM to uniform PCM, as may be needed, the input speech samples are 

40 conveniently buffered and partitioned into frames of 1 92 consecutive input speech samples (corresponding to 
24 ms of speech at an 8 kHz sampling rate). For each input speech frame, the encoder first performs linear 
prediction analysis (or LPC analysis) on the input speech in element 135 in FIG. 1 to derive a new set of re- 
flection coefficients. These coefficients are conveniently quantized and encoded into 44 bits as will be descri- 
bed in more detail in the sequel. The 192-sample speech frame is then further divided into 4 sub-frames, each 

45 having 48 speech samples (6 ms). The quantized reflection coefficients are linearly interpolated for each sub- 
frame and converted to LPC predictor coefficients. A 10th order pole-zero weighting filter is then derived for 
each sub-frame based on the interpolated LPC predictor coefficients. 

For each sub-frame, the interpolated LPC predictor is used to produce the LPC prediction residual, which 
is, in turn, used by a pitch estimator to determine the bulk delay (or pitch lag) of the pitch predictor, and by the 

50 pitch predictor coefficient vector quantizer to determine the 3 tap weights of the pitch predictor. The pitch lag 
is illustratively encoded into 7 bits, and the 3 taps are illustratively vector quantized into 6 bits. Unlike the LPC 
predictor, which is encoded and transmitted once a frame, the pitch predictor is quantized, encoded, and trans- 
mitted once per sub-frame. Thus, for each 192-sample frame, there are a total of 44 + 4x(7 + 6) = 96 bits al- 
located to side information in the illustrative embodiment of FIG. 1. 

55 Once the two predictors are quantized and encoded, each 48-sample sub-frame is further divided into 12 

speech vectors, each 4 samples long. For each 4-sample speech vector, the encoder passes each of the 64 
possible excitation codevectors through the gain scaling unit and the two synthesis filters (predictors 103 and 
104, with their respective summers) in FIG. 1. From the resulting 64 candidate synthesized speech vectors, 
and with the help of the perceptual weighting filter 120, the encoder identifies the one that minimizes a fre- 
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quency- weighted mean-squared error measure with respect to the input signal vector. The 6-bit codebook in- 
dex of the corresponding best codevector that produces the best candidate synthesized speech vector is trans- 
mitted to the decoder. The best codevector is then passed through the gain scaling unit and the synthesis 

5 filter to establish the correct filter memory in preparation for the encoding of the next signal vector. The exci- 
tation gain is updated once per vector with a backward adaptive algorithm based on the gain information em- 
bedded in previously quantized and gain-scaled excitation vectors. The excitation VQ output bit-stream and 
the side information bit-stream are multiplexed together in element 137 in FIG. 1 as described more fully in 
Section 5, and transmitted on output 138 (directly or indirectly via storage media) to the VMC decoder as illu- 

10 strated by channel/storage element 140. 

2. VMC Decoder Overview 

As in the coding phase, the decoding operation is also performed on a frame-by-frame basis. On receiving 
15 or retrieving a complete frame of VMC encoded bits on input 150, the VMC decoder first demultiplexes the 
side information bits and the excitation bits in demultiplex and decode element 155 in FIG. 1. Element 155 then 
decodes the reflection coefficients and performs linear interpolation to obtain the interpolated LPC predictor 
for each sub-frame. The resulting predictor information is then supplied to short-term predictor 175. The pitch 
lag and the 3 taps of the pitch predictor are also decoded for each sub-frame and provided to long term- 
20 predictor 1 70. Then, the decoder extracts the transmitted excitation code vectors from the excitation codebook 
160 using table look-up. The extracted excitation codevectors, arranged in sequence, are then passed through 
the gain scaling unit 165 and the two synthesis filters 170 and 175 shown in FIG. 1 to produce decoded speech 
samples on lead 180. The excitation gain is updated in backward gain adapter 168 with the same algorithm 
used in the encoder. The decoded speech samples are next illustratively converted from linear PCM format 
25 to n-law PCM format suitable for D/A conversion in a n-law PCM codec. 

3. VMC Encoder Operation 

FIG. 2 is a detailed block schematic of the VMC encoder. The encoder in FIG. 2 is logically equivalent to 
30 the encoder previously shown in FIG: 1 but the system organization of FIG. 2 proves computationally more 
efficient in implementation for some applications. 
In the following detailed description, 

1. For each variable to be described, k is the sampling index and samples are taken at 125 [is intervals. 

2. A group of 4 consecutive samples in a given signal is called a vector of that signal. For example, 4 con- 
35 secutive speech samples form a speech vector, 4 excitation samples form an excitation vector, and so on. 

3. n is used to denote the vector index, which is different from the sample index k. 

4. f is used to denote the frame index. 

Since the illustrative VMC coder is mainly used to encode speech, in the following description we assume 
that the input signal is speech, although it can be a non-speech signal, including such non-speech signals as 
40 multi-frequency tones used in communications signaling, e.g., DTMF tones. The various functional blocks in 
the illustrative system shown in FIG. 2 are described below in an order roughly the same as the order in which 
they are performed in the encoding process. 

3.1 Input PCM Format Conversion, 1 

45 

This input block 1 converts the input 64 kbit/s u-law PCM signal s Q (k) to a uniform PCM signal s u (k), an 
operation well known in the art 

3.2 Frame Buffer, 2 

50 

This block has a buffer that contains 264 consecutive speech samples, denoted s u (192f+1), s u (192f+2), 
s u (192f+3), s u (192f+264), where f is the frame index. The first 192 speech samples in the frame buffer are 
called the current frame. The last 72 samples in the frame buffer are the first 72 samples (or the first one and 
a half sub-frames) of the next frame. These 72 samples are needed in the encoding of the current frame, be- 
55 cause the Hamming window illustratively used for LPC analysis is not centered at the current frame, but is ad- 
vantageously centered at the fourth sub-frame of the current frame. This is done so that the reflection coef- 
ficients can be linearly interpolated for the first three sub-frames of the current frame. 

Each time the encoder completes the encoding of one frame and is ready to encode the next frame, the 
frame buffer shifts the buffer contents by 192 samples (the oldest samples are shifted out) and then fills the 
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vacant locations with the 192 new linear PCM speech samples of the next frame. For example, the first frame 

after coder start-up is designated frame 0 (with f = 0). The frame buffer 2 contains Su(1 ), s u (2) s u (264) while 

encoding frame 0; the next frame is designated frame f, and the frame buffer contains s u (193), S u (194), s u (456) 
5 while encoding frame 1 , and so on. 

3.3 LPC Predictor Analysis, Quantization, and Interpolation, 3 

This block derives, quantizes and encodes the reflection coefficients of the current frame. Also, once per 
w sub-frame, the reflection coefficients are interpolated with those from the previous frame and converted into 
LPC predictor coefficients. Interpolation is inhibited on the first frame following encoder initialization (reset) 
since there are no reflection coefficients from a previous frame with which to perform the interpolation. The 
LPC block (block 3 in FIG. 2) is expanded in FIG. 4; and that LPC block will now be described in more detail 
with reference to FIG. 4. 

15 The Hamming window module (block 61 in FIG. 4) applies a 192-point Hamming window to the last 192 
samples stored in the frame buffer. In other words, if the output of the Hamming window module (or the window- 
weighted speech) is denoted by ws(1), ws(2) ws( 1 92), then the weighted samples are computed according 

to the following equation. 

ws(k) = s u (192f + 72 + k)[0.64 - 0.46cos(2rc(k - 1)/191)] , k = 1,2,..., 192. (1) 

20 The autocorrelation computation module (block 62) then uses these window-weighted speech samples to com- 
pute the autocorrelation coefficients R(0), R(1), R(2) R(10) based on the following equation. 

25 R(i) = X ws(k)ws(k+i) , i = 0. 1, 2, .... 10 . (2) 

k=l 



To avoid potential ill-conditioning in the subsequent Levinson- Durbin recursion, the spectral dynamic range 
of the power spectral density based on R(0), R(1) f R(2),..., R(10) is advantageously controlled. An easy way to 

30 achieve this is by white noise correction. In principle, a small amount of white noise is added to the {ws(k)} 
sequence before computing the autocorrelation coefficients; this will fill up the spectral valleys with white 
noise, thus reducing the spectral dynamic range and alleviating ill-conditioning. In practice, however, such an 
operation is mathematically equivalent to increasing the value of R(0) by a small percentage. The white noise 
correction module (block 63) performs this function by slightly increasing R(0) by a factor of w. 

35 R(0)<-wR(0) 

Since this operation is only done in the encoder, different implementations of VMC can use different WNCF 
without affecting the inter-operability between coder implementations. Therefore, fixed-point implementations 
may, e.g., use a larger WNCF for better conditioning, while floating-point implementations may use a smaller 
WNCF for less spectral distortion from white noise correction. A suggested typical value of WNCF for 32-bit 

40 floating-point implementations is 1.0001. The suggested value of WNCF for 16- bit fixed- point implementations 
is (1 + 1/256). This later value of(1 + 1/256) corresponds to adding white noise at a level 24 dB below the aver- 
age speech power. It is considered the maximum reasonable WNCF value, since too much white noise cor- 
rection will significantly distort the frequency response of the LPC synthesis filter (sometimes called LPC spec- 
trum) and hence coder performance will deteriorate. 

45 The well-known Levinson-Durbin recursion module (block 64) recursively computes the predictor coeffi- 

cients from order 1 to order 10. Let the j-th coefficients of the i-th order predictor be denoted by af and let the 
i-th reflection coefficient be denoted by k<. Then, the recursive procedure can be specified as follows: 

E(0) - R(0) (4a) 

50 

R(i) + 'j;'aj 1 - 1, R(i-j) 
k ' HiTu <4b) 



55 



af> = k, (4c) 
ajo = + Mt]' . 1 = J - 1 (4d) 
E(i) = (1 - k?)E(i-1) (4e). 
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Equations (4b) through (4e) are evaluated recursively for i = 1, 2,..., 10, and the final solution Is given by 

5i = af 1l », 1 siisi 10. (4f) 

If we define a 0 = 1 , then the 1 0-th order prediction-error filter (sometimes called inverse fitter, or anafysis 
filter) has the transfer function 

10 

A(z) = liiZ" 1 , (4g) 

and the corresponding 10-th order linear predictor is defined by the following transfer function 
10 

P(z) = - Z 5 i z_I • ( 4 h) 
i=i 



The bandwidth expansion module (block 65) advantageously scales the unquantized LPC predictor coef- 
ficients (*i f s in Eq. (4f)) so that the 10 poles of the corresponding LPC synthesis filter are scaled radially to- 
ward the origin by an illustrative constant factor of y = 0.9941 . This corresponds to expanding the bandwidths 
of LPC spectral peaks by about 15 Hz. Such an operation is useful in avoiding occasional chirps in the coded 
25 speech caused by extremely sharp peaks in the LPC spectrum. The bandwidth expansion operation is defined 
by 

a, = *i'y*,\ - 0,1,2,3 10, (5) 

where y= 0.9941. 

3q The next step is to convert the bandwidth-expanded LPC predictor coefficients to reflection coefficients 

for quantization (done in block 66). This is done by a standard recursive procedure, going from order 10 back 
down to order 1 . Let km be the m-th reflection coefficient and a ( 7 J be the i-th coefficient of the m-th order pre- 
dictor. The recursion goes as follows. For m = 10, 9, 8,..., 1, evaluate the following two expressions: 

k m = (6a) 

am = 3 r ^_nLd , i = 1, 2,..., m - 1 (6b) 

1 - 

The 10 resulting reflection coefficients are then quantized and encoded into 44 bits by the reflection coefficient 
quantization module (block 67). The bit allocation is 6,6,5,5,4,4,4,4,3,3 bits for the first through the tenth re- 
flection coefficients (using 10 separate scalar quantizers). Each of the 10 scalar quantizers has two pre-com- 
puted and stored tables associated with it. The first table contains the quantizer output levels, while the second 
table contains the decision thresholds between adjacent quantizer output levels (i.e. the boundary values be- 
tween adjacent quantizer cells). For each of the 10 quantizers, the two tables are advantageously obtained 
by first designing an optimal non-uniform quantizer using arc sine transformed reflection coefficients as train- 
ing data, and then converting the arc sine domain quantizer output levels and cell boundaries back to the reg- 
ular reflection coefficient domain by applying the sine function. An illustrative table for each of the two groups 
of reflection coefficient quantizer data are given in Appendices A and B. 

The use of the tables will be seen to be in contrast with the usual arc sine transformation calculations for 
each reflection coefficient. Thus transforming the reflection coefficients to the arc sine transform domain 
where they would be compared with quantization levels to determine the quantization !eve! having the mini- 
mum distance to the presented value is avoided in accordance with an aspect of the present invention. Likewise 
a transform of the selected quantization level back to the reflection coefficient domain using a sine transform 
is avoided. 

The illustrative quantization technique used provides instead for the creation of the tables of the type ap- 
pearing in Appendices A and B, representing the quantizer output levels and the boundary levels (or thresholds) 
between adjacent quantizer levels. 

During encoding, each of the 10 unquantized reflection coefficients is directly compared with the elements 
of its individual quantizer cell boundary table to map it into a quantizer ceil. Once the optimal cell is identified, 
the cell index is then used to look up the corresponding quantizer output level in the output level table. Fur- 
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thermore, rather than sequentially comparing against each entry in the quantizer cell boundary table, a binary 
tree search can be used to speed up the quantization process. 

For example, a 6-bit quantizer has 64 representative levels and 63 quantizer cell boundaries. Rather than 

5 sequentially searching through the cell boundaries, we can first compare with the 32nd boundaries to decide 
whether the reflection coefficient lies in the upper half or the lower half. Suppose it is in the lower half, then 
we go on to compare with the middle boundary (the 16th) of the lower half, and keep going like this unit until 
we finish the 6th comparison, which should tell us the exact cell the reflection coefficient lies. This is consid- 
erably faster than the worst case of 63 comparisons in sequential search. 

10 Note that the quantization method described above should be followed strictly to achieve the same opti- 

mal ity as an arc sine quantizer. In general, different quantizer output will be obtained if one uses only the quan- 
tizer output level table and employs the more common method of distance calculation and minimization. This 
is because the entries in the quantizer cell boundary table are not the mid-points between adjacent quantizer 
output levels. 

15 Once all 10 reflection coefficients are quantized and encoded into 44 bits, the resulting 44 bits are passed 

to the output bit-stream multiplexer where they are multiplexed with the encoded pitch predictor and excitation 
information. 

For each sub-frame of 48 speech samples (6 ms), the reflection coefficient interpolation module (block 
68) performs linear interpolation between the quantized reflection coefficients of the current frame and those 
20 of the previous frame. Since the reflection coefficients are obtained with the Hamming window centered at 
the fourth sub-frame, we only need to interpolate the reflection coefficients for the first three sub-frames of 

each frame. Let k„, and be the m-th quantized reflection coefficients of the previous frame and the current 
frame, respectively, and let kmfl) be the interpolated m-th reflection coefficient for the j-th sub-frame. Then, 
25 kniti) <s computed as 

Mi) = (1 - \)Ku + £ km ,m = 1,2 10, and j = 1,2,3,4. (7) 

Note that interpolation is inhibited on the first frame following encoder initialization (reset). 

The last step is to use block 69 to convert the interpolated reflection coefficients for each sub-frame to 
the corresponding LPC predictor coefficients. Again, this is done by a commonly known recursive procedure, 
but this time the recursion goes from order 1 to order 10. For simplicity of notation, let us drop the sub-frame 
index j, and denote the m-th reflection coefficient by k„,. Also, let a, (m) be the i-th coefficient of the m-th order 
LPC predictor. Then, the recursion goes as follows. With a? defined as 1, evaluate af° according to the fbl- 
35 lowing equation for m = 1, 2 10. 

a (m-l). if i = o 

4 m ~ l) + k^a&L-i 1 ^ if i = 1,2 ra-1 (8) 

km. if i = ro 

The final solution is given by 
45 ao = 1, 

a, = a} 1 *, i = 1, 2,..., 10 . (9) 

The resulting a,'s are the quantized and interpolated LPC predictor coefficients for the current sub-frame. 

These coefficients are passed to the pitch predictor analysis and quantization module, the perceptual weighting 

filter update module, the LPC synthesis filter, and the impulse response vector calculator. 
so Based on the quantized and interpolated LPC coefficients, we can define the transfer function of the LPC 

inverse filter as 



to 

A(z) = Zasz" 1 , (10) 

i=0 

and the corresponding LPC predictor is defined by the following transfer function 



40 
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P2OO = " ZajZ" 1 . (11) 
s i=l 

The LPC synthesis filter has a transfer function of 

F 2 (z) = . (12) 

1=0 



15 



3.4 Pitch Predictor Analysis and Quantization, 4 



The pitch predictor analysis and quantization block 4 in FIG. 2 extracts the pitch lag and encodes it into 7 
bits, and then vector quantizes the 3 pitch predictor taps and encodes them into 6 bits. The operation of this 
block is done once each sub-frame. This block (block 4 in FIG. 2) is expanded in FIG. 5. Each block in FIG. 5 
will now be explained in more detail. 
20 The 48 input speech samples of the current sub-frame (from the frame buffer) are first passed through 

the LPC inverse filter (block 72) defined in Eq. (10). This results in a sub-frame of 48 LPC prediction residual 
samples. 

d(k) = s u (k) + 5>iS u (k-i) * k = ! ' 2 48 • < 13 > 

i=l 

These 48 residual samples then occupy the current sub-frame in the LPC prediction residual buffer 73. 

30 The LPC prediction residual buffer (block 73) contains 169 samples. The last 48 samples are the current 

sub-frame of (unquantized) LPC prediction residual samples obtained above. However, the first 121 samples 

d(-120), d(-119) d(0) are populated by quantized LPC prediction residual samples of previous sub-frames, 

as indicated by the 1 sub-frame delay block 71 in FIG. 5. (The quantized LPC prediction residual is defined as 
the input to the LPC synthesis filter.) The reason to use quantized LPC residual to populate the previous sub- 

35 frames is that this is what the pitch predictor will see during the encoding process, so it makes sense to use 
it to derive the pitch lag and the 3 pitch predictor taps. On the other hand, because the quantized LPC residual 
is not yet available for the current sub-frame, we obviously cannot use it to populate the current sub-frame of 
the LPC residual buffer; hence, we must use the unquantized LPC residual for the current frame. 

Once this mixed LPC residual buffer is loaded, the pitch lag extraction and encoding module (block 74) 

40 uses it to determine the pitch lag of the pitch predictor. While a variety of pitch extraction algorithms with rea- 
sonable performance can be used, an efficient pitch extraction algorithm with low implementation complexity 
that has proven advantageous will be described. 

This efficient pitch extraction algorithm works in the following way. First, the current sub-frame of the LPC 
residual is lowpass filtered (e.g., 1 kHz cut-off frequency) with a third-order elliptic filter of the form. 

45 

EM-* 

JJz) = _££^ (13a) 

1 + Eajz"' 

i=l 

and then 4:1 decimated (i.e. down-sampled by a factor of 4). This results in 12 lowpass filtered and decimated 
55 LPC residual samples, denoted d(1), d(2) d(12), which are stored in the current sub-frame (12 samples) of a 
decimated LPC residual buffer. Before these 12 samples, there are 30 more samples d(-29), d(-28) d(0) 
in the buffer that are obtained by shifting previous sub-frames of decimated LPC residual samples. The i-th 
cross-correlation of the decimated LPC residual samples are then computed as 
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P(i) = Z d(n)d(n-i) 



(14) 



10 



for time lags i = 5, 6, 7 30 (which correspond to pitch lags from 20 to 120 samples). The time lag t that gives 

the largest of the 26 calculated cross-correlation values is then identified. Since this time lag t is the lag in 
the 4:1 decimated residual domain, the corresponding time lag that yields the maximum correlation in the orig- 
inal undecimated residual domain should lie between 4x-3 and 4t+3. To get the original time resolution, we 
next use the undecimated LPC residual to compute the crosscorrelation of the undecimated LPC residual 



15 



48 



c(i) = 23d(k)d<k-i) 



(15) 



20 



25 



30 



for 7 lags i = 4t-3, 4x-2 4t+3. Of the 7 possible lags, the lag p that gives the largest cross-correlation C(p) 

is the output pitch lag to be used in the pitch predictor. Note that the pitch lag obtained this way could turn out 
to be a multiple of the true fundamental pitch period, but this does not matter, since the pitch predictor still 
works well with a multiple of the pitch period as the pitch lag. 

Since there are only 101 possible pitch periods (20 to 120) in the illustrative implementation, 7 bits are 
sufficient to encode this pitch lag without distortion. The 7 pitch lag encoded bits are passed to the output bit- 
stream multiplexer once a sub-frame. 

The pitch lag (between 20 and 120) is passed to the pitch predictor tap vector quantizer module (block 
75), which quantizes the 3 pitch predictor taps and encodes them into 6 bits using a VQ codebook with 64 
entries. The distortion criterion of the VQ codebook search is the energy of the open-loop pitch prediction re- 
sidual, rather than a more straightforward mean-squared error of the three taps themselves. The residual en- 
ergy criterion gives better pitch prediction gain than the coefficient MSE criterion. However, it normally requires 
much higher complexity in the VQ codebook search, unless a fast search method is used. In the following, we 
explain the principles of the fast search method used in VMC. 

Let b it b 2 , and b 3 be the three pitch predictor taps and p be the pitch lag determined above. Then, the 
three-tap pitch predictor has a transfer function of 



35 



Pi(z)=EM" p+2 " 1 . 
i=i 



(16) 



40 



45 



The energy of the open-loop pitch prediction residual is 



48 
k=l 



d(k) - £bid(k-p + 2 

i=l 



(17) 



= E - 2£biV(2-p.i) + iibibjvG.j) 

i=J i = li=l 



(18) 



where 



55 



V0.j)= Id(k-p+2-i)d(k-p + 2-j), 



(19) 



and 
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E = £d 2 (k) . (20) 
k=l 

5 

Note that D can be expressed as 

D = E - c T y (21) 

where 

10 C T = f¥(2 - P,1),^(2 - p,2),<F(2 - p f 3) t 'F(1 f 2),'F(2.3) ( Y(3.1) l V(1 v 1) > 'F(2.2) ( Y(3,3)] . (22) 

and 

y = [2b 1( 2b 2f 2b3, - 2b,b 2 , -2b 2 b 3 , - 2b 3 b 1t - b*. - b*. - b*]T ( 2 3) 
(the superscript T denotes transposition of a vector or a matrix). Therefore, minimizing D is equivalent to max- 
imizing c T y, the inner product of two 9-dimensional vectors. For each of the 64 candidate sets of pitch predictor 

15 taps in the 6-bit codebook, there is a corresponding 9-dimensional vector y associated with it. We can pre- 
compute and store the 64 possible 9-dimensional y vectors. Then, in the codebook search for the pitch pre- 
dictor taps, the 9-dimensional vector c is first computed; then, the 64 inner products with the 64 stored y vectors 
are calculated, and the y vector with the largest inner product is identified. The three quantized predictor taps 
are then obtained by multiplying the first three elements of this y vector by 0.5. The 6-bit index of this code- 

20 vector y is passed to the output bit-stream multiplexer once per sub-frame. 

3.5 Perceptual Weighting Filter Coefficient Update Module 

The perceptual weighting update block 5 in FIG. 2 calculates and updates the perceptual weighting filter 
25 coefficients once a sub-frame according to the next three equations: 

W(Z) = S ,0<Y2<71 " 1, (24) 



30 



35 



55 



10 

A(z/y x ) = £(ai y{)z~ l , (25) 

i=0 



and 



10 

A(z/y 2 ) = 2< a i Y2)*" 1 . (26) 

40 i-0 

where ai's are the quantized and interpolated LPC predictor coefficients. The perceptual weighting filter is il- 
lustratively a 10-th order pole-zero filter defined by the transfer function W(z) in Eq. (24). The numerator and 
denominator polynomial coefficients are obtained by performing bandwidth expansion on the LPC predictor 

45 coefficients, as defined in Eqs. (25) and (26). Typical values of yi and y 2 are 0.9 and 0.4, respectively. The 
calculated coefficients are passed to three separate perceptual weighting filters (blocks 6, 10, and 24) and 
the impulse response vector calculator (block 12). 

So far the frame-by-frame orsubframe-by-subframe updates of the LPC predictor, the pitch predictor, and 
the perceptual weighting filter have all been described. The next step is to describe the vector-by-vector en- 

50 coding of the twelve 4-dimensional excitation vectors within each sub-frame. 

3.6 Perceptual Weighting Filters 



There are three separate perceptual weighting filters in FIG. 2 (blocks 6, 10, and 24) with identical coef- 
ficients but different filter memory. We first describe block 6. In FIG. 2, the current input speech vector s(n) 
is passed through the perceptual weighting filter (block 6), resulting in the weighted speech vector v(n). Note 
that since the coefficients of the perceptual weighting filter are time- varying, the direct-form II digital filter 
structure is no longer equivalent to the direct-form I structure. Therefore, the input speech vector s(n) should 
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first be filtered by the FIR section and then by the IIR section of the perceptual weighting filter. Also note that 
except during initialization (reset), the filter memory (i.e. internal state variables, or the values held In the delay 
units of the filter) of block 6 should not be reset to zero at any time. On the other hand, the memory of the 
5 other two perceptual weighting filters (blocks 10 and 24) requires special handling as described later. 



3.7 Pitch Synthesis Filters 



There are two pitch synthesis filters in FIG. 2 (block 8 and 22) with identical coefficients but different filter 
10 memory. They are variable-order, all-pole filters consisting of a feedback loop with a 3- tap pitch predictor in 
the feedback branch (see FIG. 1). The transfer function of the filter is 

F1(Z) = (27 > 

where P 1 (z) is the transfer function of the 3 -tap pitch predictor defined in Eq. (16) above. The filtering operation 
is and the filter memory update require special handling as described later. 



3.8 LPC Synthesis Filters 



There are two LPC synthesis filters in FIG. 2 (blocks 9 and 23) with identical coefficients but different filter 
20 memory. They are 10-th order all-pole filters consisting of a feedback loop with a 10-th order LPC predictor 
in the feedback branch (see FIG. 1). The transfer function of the filter is 

™ = T^0=Afe- < 28 > 

where P 2 (z) and A(z) are the transfer functions of the LPC predictor and the LPC inverse filter, respectively, 
25 as defined in Eqs. (10) and (11). The filtering operation and the filter memory update require special handling 
as described next 



3.9 Zero-Input Response Vector Computation 



30 To perform a computationally efficient excitation VQ code bo ok search, it is necessary to decompose the 

output vector of the weighted synthesis filter (the cascade filter composed of the pitch synthesis filter, the LPC 
synthesis filter, and the perceptual weighting filter) into two components: the zero-input response (ZIR) vector 
and the zero-state response (ZSR) vector. The zero-input response vector is computed by the lower filter 
branch (blocks 8, 9, and 10) with a zero signal applied to the input of block 8 (but with non-zero filter memory). 

35 The zero-state response vector is computed by the upper filter branch (blocks 22, 23, and 24) with zero filter 
states (filter memory) and with the quantized and gain-scaled excitation vector applied to the input of block 
22. The three filter memory control units between the two filter branches are there to reset the filter memory 
of the upper (ZSR) branch to zero, and to update the filter memory of the lower (ZIR) branch. The sum of the 
ZIR vector and the ZSR vector will be the same as the output vector of the upper filter branch if it did not have 

*o filter memory resets. 

In the encoding process, the ZIR vector is first computed, the excitation VQ codebook search is next per- 
formed, and then the ZSR vector computation and filter memory updates are done. The natural approach is 
to explain these tasks in the same order. Therefore, we will only describe the ZIR vector computation in this 
section and postpone the description of the ZSR vector computation and filter memory update until later. 

45 To compute the current ZIR vector r(n), we apply a zero input signal at node 7, and let the three filters in 

the ZIR branch (blocks 8, 9, and 10) ring for 4 samples (1 vector) with whatever filter memory was left after 
the memory update done for the previous vector. This means that we continue the filtering operation for 4 sam- 
ples with a zero signal applied at node 7. The resulting output of block 10 is the desired ZIR vector r(n). 

Note that the memory of the filters 9 and 10 is in general non-zero (except after initialization); therefore, 

so the output vector r(n) is also non-zero in general, even though the filter input from node 7 is zero. In effect, 
this vector r(n) is the response of the three filters to previous gain-scaled excitation vectors e(n-1), e(n-2),... . 
This vector represents the unforced response associated with the filter memory up to time (n-1). 

3.10 VQ Target Vector Computation 11 

55 

This block subtracts the zero-input response vector r(n) from the weighted speech vector v(n) to obtain 
the VQ codebook search target vector x(n). 
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3.11 Backward Vector Gain Adaptor 20 

The backward gain adapter block 20 updates the excitation gain o(n) for every vector time index n. The 
5 excitation gain o(n) is a scaling factor used to scale the selected excitation vector y(n). This block takes the 
selected excitation codebook index as its input and produces an excitation gain a(n) as its output. This func- 
tional block seeks to predict the gain of e(n) based on the gain of e(n-1) by using adaptive first-order linear 
prediction in the logarithmic gain domain. (Here, the gain of a vector is defined as the root-mean-square (RMS) 
value of the vector, and the log-gain is the dB level of the RMS value.) This backward vector gain adapter 20 
w is shown in more detail in FIG. 6. 

Refer to FIG. 6. Let j(n) denote the winning 5-bit excitation shape codebook index selected for time n. Then, 
the 1 -vector delay unit 81 makes available j(-1), the index of the previous excitation vector y(n-1). With this 
index j (n-1), the excitation shape codevector log-gain table (block 82) performs a table look-up to retrieve the 
dB value of the RMS value of y(n - 1). This table is conveniently obtained by first calculating the RMS value 
15 of each of the 32 shape codevectors, then taking base 10 logarithm and multiplying the result by 20. 

Let cr e (n-1) and tfy(n-1) be the RMS values of e(n-1) and y(n-1), respectively. Also, let their corresponding 
dB values be 

g e (n-1) = 20 log 10 a e (n - 1) , (29) 

and 

20 g y (n - 1) = 20 log 10 a y (n - 1) . (30) 

In addition, define 

g(n- 1) = 20log 10 a(n- 1). (31) 
By definition, the gain-scaled excitation vector e(n-1) is given by 

e(n-1) = a(n-1)y(n-1) (32) 

25 Therefore, we have 

o e (n - 1) = cr(n - 1)a y (n - 1) . (33) 

or 

g e (n-1) = g(n-1) + g y (n - 1) . (34) 
Hence, the RMS dB value (or tog-gain) of e(n-1) is the sum of the previous log-gain g(n - 1 ) and the log-gain 
30 9y( n_ i ) °f tne previous excitation codevector y(n-1). 

The shape codevector log-gain table 82 generates g y (n-1), and the 1 -vector delay unit 83 makes the pre- 
vious log-gain g(n-1) available. The adder 84 then adds the two terms together to get g e (n-1), the log-gain of 
the previous gain-scaled excitation vector e (n - 1). 

In FIG. 6, a log-gain offset value of 32 dB is stored in the log-gain offset value holder 85. (This value is 
35 meant to be roughly equal to the average excitation gain level, in dB, during voiced speech assuming the input 
speech was u-law encoded and has a level of -22 dB below saturation.) The adder 86 subtracts this 32 dB log- 
gain offset value from g e (n - 1). The resulting offset-removed log-gain 8 (n - 1) is then passed to the log-gain 
linear predictor 91; it is also passed to the recursive windowing module 87 to update the coefficient of the log- 
gain linear predictor 91. 

40 The recursive windowing module 87 operates sample-by-sample. It feeds 5 (n - 1) through a series of delay 

units and computes the product 5 (n-1)5 (n-1-i) for i = 0, 1. The resulting product terms are then fed to two 
fixed-coefficient filters (one filter for each term), and the output of the i-th filter is the i-th autocorrelation coef- 
ficient Rg(i). We call these two fixed filters recursive autocorrelation filters, since they recursively compute 
autocorrelation coefficients as their outputs. 

45 Each of these two recursive autocorrelation filters consists of three first-order filters in cascade. The first 

two stages are identical all-pole filters with a transfer function of 1/[1 - a 2 z~ 1 ], where a = 0.94, and the third 
stage is a pole- zero filter with a transfer function of [B(0,i) + B(1 ,i)z- 1 ]/[1 - a 2 z- 1 ],where B(0,i) - (i+1)a' ( and 
B(1,i)=-(M)a M . 

Let M|j(k) be the filter state variable (the memory) of the j-th first-order section of the i-th recursive auto- 
50 correlation filter at time k. Also, let a r = a 2 be the coefficient of the all-pole sections. All state variables of the 
two recursive autocorrelation filters are initialized to zero at coder start-up (reset). The recursive windowing 
module computes the i-th autocorrelation coefficient R(i) according to the following recursion: 

Mn(k) = 6 (k)§ (k - i) + a r M M (k - 1) (35a) 
M e (k) = Mn(k) + a^k-l) (35b) 
55 M B (k) = M c (k) + a r M, 3 (k-1) (35c) 

Rg(i) = B(0,i)M,3(k) + B(1,i)M e (k- 1) (35d) 
We update the gain predictor coefficient once a sub-frame, except for the first sub-frame following initial- 
ization. For the first sub-frame, we use the initial value (1) of the predictor coefficient. Since each sub-frame 
contains 12 vectors, we can save computation by not doing the two multiply-adds associated with the all-zero 
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10 



portion of the two f titers except when processing the first value in a sub-frame (when the autocorrelation coef- 
ficients are needed). In other words, Eq. (35d) is evaluated once for every twelve speech vectors. However, 
we do have to update the filter memory of the three all-pole sections for each speech vector using Eqs. (35a) 
through (35c). 

Once the two autocorrelation coefficients Rg(i), i = 0, 1 are computed, we then calculate and quantize the 
first-order log-gain predictor coefficient using blocks 88, 89, and 90 in FIG. 6. Note that in a real-time imple- 
mentation of the VMC coder, the three blocks 88, 89, and 90 are performed in one single operation as described 
later. These three blocks are shown separately in FIG. 6 and discussed separately below for ease of under- 
standing. 

Before calculating the log-gain predictor coefficient, the log-gain predictor coefficient calculator (block 88) 
first applies a white noise correction factor (WNCF) of (1 + 1/256) to Rg(0). That is, 



15 



R g (0) = 



1 + 



256 



R.(0) = |§R t 



(0) 



(36) 



Note that even floating-point implementations have to use this white noise correction factor of 257/256 to en- 
20 sure inter-operability. The first-order log-gain predictor coefficient is then calculated as 

&1 = 3^ (37) 
Rg(0) 

Next, the bandwidth expansion module 89 evaluates 



25 



30 



35 



°I = 



(0.9)^. (38) 



Bandwidth expansion is an important step for the gain adapter (block 20 in FIG. 2) to enhance coder robustness 
to channel errors. It should be recognized that multiplier value 0.9 is merely illustrative. Other values have prov- 
en useful in particular implementations. 

The log-gain predictor coefficient quantization module 90 then quantizes & l typically using a log-gain pre- 
dictor quantizer output level table in standard fashion. The quantization is not primarily for encoding and trans- 
mission, but rather to reduce the likelihood of gain predictor mistracking between encoder and decoder and 
to simplify DSP implementations. 

With the functional operation of blocks 88, 89 and 90 introduced, we now describe the implementation pro- 
cedures for implementing these blocks in one operation. Note that since division takes many more instruction 
cycles to implement than multiplication in a typical DSP, the division specified in Eq. (37) is best avoided. This 
can be done by combining Eqs. (36) through (38) to get 
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a, = 0.9 



256 



257 



R S (D _ R 8 (D 
R g (0) ~ 1.115 R s (0) 



(39) 



45 



50 



55 



Let B| be the i-th quantizer cell boundary (or decision threshold) of the log-gain predictor coefficient quantizer. 
The quantization of a l is normally done by comparing a i with Bj's to determine which quantizer celt OL\ 

is in. However, comparing &>\ with B| is equivalent to directly comparing Rg (1) with 1.115 Bj Rg(0). Therefore, 
we can perform the function of blocks 88, 89, and 90 in one operation, and the division operation in Eq. (37) 
Is avoided. With this approach, efficiency is best served by storing 1.115 B- rather than B. as the (scaled) coef- 
ficient quantizer cell boundary table. 

The quantized version of <X 1, denoted as a 1( is used to update the coefficient of the log-gain linear pre- 
dictor 91 once each sub-frame, and this coefficient update takes place on the first speech vector of every sub- 
frame. Note that the update is inhibited for the first sub-frame after coder initialization (reset). The first-order 
log-gain linear predictor 91 attempts to predicts (n) based on 8 (n - 1). The predicted version of 6 (n), denoted 
as 5 (n), is given by 

8(n) = a,8(n-1). (40) 
After 5 (n) has been produced by the tog-gain linear predictor 91, we add back the log-gain offset value 
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of 32 dB stored In block 85. The log-gain limiter 93 then checks the resulting log-gain value and dips it if the 
value is unreasonably large or small. The lower and upper limits for clipping are set to 0 dB and 60 dB, respec- 
tively. The gain limiter ensures that the gain in the linear domain is between 1 and 1000. 
5 The log-gain limiter output is the current tog-gain g(n). This log-gain value is fed to the delay unit 83. The 

inverse logarithm calculator 94 then converts the log-gain g (n) back to the linear gain o(n) using the equation: 
a(n) = 10^ . This linear gain a(n) is the output of the backward vector gain adapter (block 20 in FIG. 2). 

3.12 Excitation Codebook Search Module 

10 

In FIG. 2, blocks 12 through 18 collectively form an illustrative codebook search module 100. This module 
searches through the 64 candidate codevectors in the excitation VQ codebook (block 19) and identifies the 
index of the codevectorthat produces a quantized speech vector closest to the input speech vector with respect 
to an illustrative perceptually weighted mean-squared error metric. 

15 The excitation codebook contains 64 4-dimensional codevectors. The 6 codebook index bits consist of 1 

sign bit and 5 shape bits. In other words, there is a 5-bit shape codebook that contains 32 linearly independent 
shape codevectors, and a sign multiplier of either +1 or -1, depending on whether the sign bit is 0 or 1. This 
sign bit effectively doubles the codebook size without doubling the codebook search complexity. It makes the 
6-bit codebook symmetric about the origin of the 4-dimensional vector space. Therefore, each codevector in 

20 the 6-bit excitation codebook has a mirror image about the origin that is also a codevector in the codebook. 
The 5-bit shape codebook is advantageously a trained codebook, e.g., using recorded speech material in the 
training process. 

Before describing the illustrative codebook search procedure in detail, we first briefly review the broader 
^ aspects of an advantageous codebook search technique. 

3.12.1 Excitation Codebook Search Overview 

In principle, the illustrative codebook search module scales each of the 64 candidate codevectors by the 
current excitation gain o(n) and then passes the resulting 64 vectors one at a time through a cascade filter 
*° consisting of the pitch synthesis filter F t (z), the LPC synthesis filter F 2 (z), and the perceptual weighting filter 
W(z). The filter memory is initialized to zero each time the module feeds a new codevector to the cascade filter 
(transfer function H(z) = (z) F 2 (z) W (z)). 

This type of zero-state filtering of VQ codevectors can be expressed in terms of matrix-vector multiplication. 
Let yj be the j-th codevector in the 5-bit shape codebook, and let g, be the i-th sign multiplier in the 1-bit sign 
multiplier codebook (g 0 = + 1 and g 1 = -1). Let {h(k)} denote the impulse response sequence of the cascade 
filter H(z). Then, when the codevector specified by the codebook indices i and j is fed to the cascade filter 
H(z), the filter output can be expressed as 

*U = Ha(n)g,y jf (41) 

where 







h(0) 
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0 0 
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h(l) 


h(0) 


0 0 






h(2) 


Ml) 


h(0) 0 






h(3) 


h(2) 


MD M0) 



(42) 



The codebook search module searches for the best combination of indices i and j which minimizes the 
following Mean-Squared Error (MSE) distortion 

D = || x(n) - *u || 2 = a2(n)i|x(n) - g.HyjP, (43) 
where x(n) = x(n)/a(n) is the gain-normalized VQ target vector, and the notation || x || means the Euclidean norm 
of the vector x. Expanding the terms gives 



15 



EP0 573 216 A2 



D = o 2 (n) [|| x(n) || 2 - 2 fii x T (n)H yj + g?|| Hyj || 2 ] . (44) 

Since g? = 1 and the values of [| x(n) || 2 and a^n) are fixed during the codebook search, minimizing D is 
equivalent to minimizing 

D = - giP T (n)yj + E, , (45) 

where 

p(n) = 2 H T x(n) , (46) 

and 

E, = UHyjP. (47) 

Note that Ej is actually the energy of the j-th filtered shape codevectors and does not depend on the VQ 
target vector x(n). Also note that the shape code vector yj is fixed, and the matrix H only depends on the cascade 
filter H(z), which is fixed over each sub-frame. Consequently, Ej is also fixed over each sub-frame. Based on 
this observation, when the filters are updated at the beginning of each sub-frame, we can compute and store 
the 32 energy terms E Jf j = 0, 1, 2 .... 31, corresponding to the 32 shape codevectors, and then use these energy 
terms in the codebook search for the 12 excitation vectors within the sub-frame. The precomputation of the 
energy terms, Ej, reduces the complexity of the codebook search. 

Note that for a given shape codebook index j, the distortion term defined in Eq. (45) will be minimized if 
the sign multiplier term g is chosen to have the same sign as the inner product term p T (n) y Jt Therefore, the 
best sign bit for each shape codevector is determined by the sign of the inner product p T (n)vj. Hence, in the 
codebook search we evaluate Ecj. (45) for j = 0, 1 , 2,..., 31 , and pick the shape index j(n) and the corresponding 
sign index i(n) that minimizes D. Once the best indices i and j are identified, they are concatenated to form 
the output of the codebook search module — a single 6-bit excitation codebook index. 

3.12.2 Operation of the Excitation Codebook Search Module 

With the illustrative codebook search principles introduced, the operation of the codebook search module 
100 is now described below. Refer to FIG. 2. Every time the coefficients of the LPC synthesis filter and the 
perceptual weighting filter are updated at the beginning of each sub-frame, the impulse response vector cal- 
culator 12 computes the first 4 samples of the impulse response of the cascade filter F 2 (z) W(z). (Note that 
Fi (z) is omitted here, since the pitch lag of the pitch synthesis filter is at least 20 samples, and so F t (z) cannot 
influence the impulse response of H(z) before the 20-th sample.) To compute the impulse response vector, 
we first set the memory of the cascade filter F 2 (z) W(z) to zero, and then excite the filter with an input sequence 

{1 , 0, 0, 0}. The corresponding 4 output samples of the filter are h(0), h(1) h(3), which constitute the desired 

impulse response vector. The impulse response vector is computed once per sub-frame. 

Next, the shape codevector convolution module 13 computes the 32 vectors Hyjj « 0, 1, 2 31. In other 

words, it convolves each shape codevector yjj = 0, 1,2, 31 with the impulse response sequence h(0), 
h(1), h(3),where the convolution is only performed for the first 4 samples. The energy of the resulting 32 
vectors are then computed and stored by the energy table calculator 14 according to Eq. (47). The energy of 
a vector is defined as the sum of the squares of the vector components. 

Note that the computations in blocks 12, 13, and 14 are performed only once a sub-frame, while the other 
blocks in the codebook search module 100 perform computations for each 4-dimensional speech vector. 

The VQ target vector normalization module 15 calculates the gain-normalized VQ target vector x(n) = 
x(n)/a(n). In DSP implementations, it is more efficient to first compute 1/a(n), and then multiply each component 
of x(n) by 1/a(n). 

Next, the time-reversed convolution module 1 6 computes the vector p(n) = 2H T x(n). This operation is equiv- 
alent to first reversing the order of the components of x(n), then convolving the resulting vector with the impulse 
response vector, and then reverse the component order of the output again (hence the name time-reversed 
convolution). 

Once the Ej table is precomputed and stored, and the vector p(n) is calculated, then the error calculator 
17 and the best codebook index selector 1 8 work together to perform the following efficient codebook search 
algorithm. 

1. Initialize D^m to the largest number representable by the target machine implementing the VMC. 

2. Set the shape codebook index j = 0. 

3. Compute the inner product Pj = p T (n)yj. 

4. If Pj < 0, go to step 6; otherwise, compute D = -Pj + Ej and proceed to step 5. 
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A A A A 

5. If D £ D mI ^go to step 8; otherwise, set D mIn = D,i(n) = 0, and j(n) = j. 

6. Compute D = Pj + Ej and proceed to step^7. 

7. If D S D mUl , go to step 8; otherwise, set D mln = D,i(n) = 1 , and j(n) = j. 
5 8. If j < 31 , set j = j + 1 and go to step 3; otherwise proceed to step 9. 

9. Concatenate the optimal shape index, i(n), and the optimal gain index, j(n), and pass to the output bit- 
stream multiplexer. 

3.13 Zero-State Response Vector Calculation and Filter Memory Updates 

10 

After the excitation codebook search is done for the current vector, the selected codevector is used to 
obtain the zero-state response vector, that in turn is used to update the filter memory in blocks 8, 9, and 10 
in FIG. 2. 

First, the best excitation codebook index is fed to the excitation VQ codebook (block 19) to extract the cor- 
15 responding quantized excitation codevector 

y(n) = gr ( n>yj ( n) . (48) 

The gain scaling unit (block 21) then scales this quantized excitation codevector by the current excitation gain 
cr(n). The resulting quantized and gain-scaled excitation vector is computed as e(n) = a(n)y(n) (Eq. (32)). 
To compute the ZSR vector, the three filter memory control units (blocks 25, 26, and 27) first reset the 

20 filter memory in blocks 22, 23, and 24 to zero. Then, the cascade filter (blocks 22, 23, and 24) is used to filter 
the quantized and gain-scaled excitation vector e(n). Note that since e(n) is only 4 samples long and the filters 
have zero memory, the filtering operation of block 22 only involves shifting the elements of e(n) into its filter 
memory. Furthermore, the number of multiply- adds for filters 23 and 24 each goes from 0 to 3 for the 4-sample 
period. This is significantly less than the complexity of 30 multiply-adds per sample that would be required if 

25 the filter memory were not zero. 

The filtering of e(n) by filters 22, 23, and 24 will establish 4 non-zero elements at the top of the filter memory 
of each of the three filters. Next, the filter memory control unit 1 (blocks 25) takes the top 4 non-zero filter 
memory elements of block 22 and adds them one-by-one to the corresponding top 4 filter memory elements 
of block 8. (At this point, the filter memory of blocks 8, 9, and 10 is what* s left over after the filtering operation 

30 performed earlier to generate the ZIR vector r(n).) Similarly, the filter memory control unit 2 (blocks 26) takes 
the top 4 non-zero filter memory elements of block 23 and adds them to the corresponding filter memory ele- 
ments of block 9, and the filter memory control unit 3 (blocks 27) takes the top 4 non-zero filter memory ele- 
ments of block 24 and adds them to the corresponding filter memory elements of block 10. This in effect adds 
the zero-state responses to the zero-input responses of the filters 8, 9, and 1 0 and completes the filter memory 

35 update operation. The resulting filter memory in filters 8, 9, and 10 will be used to compute the zero- in put re- 
sponse vector during the encoding of the next speech vector. 

Note that after the filter memory update, the top 4 elements of the memory of the LPC synthesis filter 
(block 9) are exactly the same as the components of the decoder output (quantized) speech vector s q (n). There- 
fore, in the encoder, we can obtain the quantized speech as a by-product of the filter memory update operation. 

40 This completes the last step in the vector-by-vector encoding process. The encoder will then take the next 

speech vector s(n+1) from the frame buffer and encode it in the same way. This vector- by- vector encoding 
process is repeated until all the 48 speech vectors within the current frame are encoded. The encoder then 
repeats the entire frame-by-frame encoding process for the subsequent frames. 

45 3.14 Output Bit-Stream Multiplexer 

For each 192- sample frame, the output bit stream multiplexer block 28 multiplexes the 44 reflection coef- 
ficient encoded bits, the 13x4 pitch predictor encoded bits, and the 4x48 excitation encoded bits into a special 
frame format, as described more completely in Section 5. 

50 

4. VMC Decoder Operation 

FIG. 3 is a detailed block schematic of the VMC decoder. Afunctional description of each block is given 
in the following sections. 

55 

4.1 Input Bit-Stream Demultiplexer 41 

This block buffers the input bit-stream appearing on input 40 finds the bit frame boundaries, and demul- 
tiplexes the three kinds of encoded data: reflection coefficients, pitch predictor parameters, and excitation vec- 
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tors according to the bit frame format described in Section 5. 

4.2 Reflection Coefficient Decoder 42 

5 

This block takes the 44 reflection coefficient encoded bits from the input bit-stream demultiplexer, sepa- 
rates them into 10 groups of bits for the 10 reflection coefficients, and then performs table look-up using the 
reflection coefficient quantizer output level tables of the type illustrated in Appendix A to obtain the quantized 
reflection coefficients. 

10 

4.3 Reflection Coefficient Interpolation Module 43 
This block is described in Section 3.3 (see Eq. (7)). 

15 4.4 Reflection Coefficient to LPC Predictor Coefficient Conversion Module 44 

The function of this block is described in Section 3.3 (see Eqs. (8) and (9)). The resulting LPC predictor 
coefficients are passed to the two LPC synthesis filters (blocks 50 and 52) to update their coefficients once 
a sub-frame. 

20 

4.5 Pitch Predictor Decoder 45 

This block takes the 4 sets of 13 pitch predictor encoded bits (for the 4 sub-frames of each frame) from 
the input bit-stream demultiplexer. It then separates the 7 pitch lag encoded bits and 6 pitch predictor tap en- 

25 coded bits for each sub-frame, and calculates the pitch lag and decodes the 3 pitch predictor taps for each 
sub-frame. The 3 pitch predictor taps are decoded by using the 6 pitch predictor tap encoded bits as the address 
to extract the first three components of the corresponding 9-dimensiona! codevector at that address in a pitch 
predictor tap VQ codebook table, and then, in a particular embodiment, multiplying these three components 
by 0.5. The decoded pitch lag and pitch predictor taps are passed to the two pitch synthesis filters (blocks 49 

30 and 51). 

4.6 Backward Vector Gain Adapter 46 

This block is described in Section 3.11. 

35 

4.7 Excitation VQ Codebook 47 

This block contains an excitation VQ codebook (including shape and sign multiplier codebooks) identical 
to the codebook 19 in the VMC encoder. For each of the 48 vectors in the current frame, this block obtains 
40 the corresponding 6-bit excitation codebook index from the input bit-stream demultiplexer 41, and uses this 
6-bit index to perform a table look-up to extract the same excitation codevector y(n) selected in the VMC en- 
coder. 

4.8 Gain Scaling Unit 48 

45 

The function of this block is the same as the block 21 described in Section 3.1 3. This block computes the 
gain-scaled excitation vector as e(n) = a(n)y(n). 

4.9 Pitch and LPC Synthesis Filters 

50 

The pitch synthesis filters 49 and 51 and the LPC synthesis filters 50 and 52 have the same transfer func- 
tions as their counterparts in the VMC encoder (assuming error-free transmission). They filter the scaled ex- 
citation vector e(n) to produce the decoded speech vector s d (n). Note that if numerical round-off errors were 
not of concern, theoretically we could produce the decoded speech vector by passing e(n) through a simple 
55 cascade filter comprised of the pitch synthesis filter and LPC synthesis filter. However, in the VMC encoder 
the filtering operation of the pitch and LPC synthesis filters is advantageously carried out by adding the zero- 
state response vectors to the zero-input response vectors. Performing the decoder filtering operation in a 
mathematically equivalent, but arithmetically different way may result in perturbations of the decoded speech 
because of finite precision effects. To avoid any possible accumulation of round-off errors during decoding, it 
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is strongly recommended that the decoder exactly duplicate the procedures used in the encoder to obtain s q (n). 
In other words, the decoder should also compute s d (n) as the sum of the zero-input response and the zero- 
state response, as was done in the encoder. 
5 This is shown in the decoder of FIG. 3, where blocks 49 through 54 advantageously exactly duplicate blocks 

8 P 9, 22, 23, 25, and 26 in the encoder. The function of these blocks has been described in Section 3. 

4.10 Output PCM Format Conversion 

w This block converts the 4 components of the decoded speech vector s d (n) into 4 corresponding u-law PCM 

samples and output these 4 PCM samples sequentially at 125 us time intervals. This completes the decoding 
process. 

5. Compressed Data Format 

15 

5.1 Frame Structure 

VMC is a block coder that illustratively compresses 192 |i-law samples (192 bytes) into a frame (48 bytes) 
of compressed data. For each block of 192 input samples, the VMC encoder generates 12 bytes of side infor- 

20 mation and 36 bytes of excitation information. In this section, we will describe how the side and excitation in- 
formation are assembled to create an illustrative compressed data frame. 

The side information controls the parameters of the long- and short-term prediction filters. In VMC, the 
long-term predictor is updated four times per block (every 48 samples) and the short-term predictor is updated 
once per block (every 192 samples). The parameters of the long-term predictor consist of a pitch lag (period) 

25 and a set of three filter coefficients (tap weights). The filter taps are encoded as a vector. The VMC encoder 
constrains the pitch lag to be an integer between 20 and 120. For storage in a compressed data frame, the 
pitch lag is mapped into an unsigned 7-bit binary integer. The constraints on the pitch lag imposed by VMC 
imply that encoded lags from 0x0 to 0x13 (0 to 19) and from 0x79 to 0x7f(121 to 127) are not admissible. VMC 
allocates 6 bits for specifying the pitch filter for each 48 sample sub-frame, and so there are a total of 2 6 = 64 

30 entries in the pitch f liter VQ codebook. The pitch filter coefficients are encoded as a 6-bit unsigned binary num- 
ber equivalent to the index of the selected filter in the codebook. For the purpose of this discussion, the pitch 

lags computed for the four sub-frames will be denoted by PJ0] ,P L [1] PJ3], and the pitch filter indices will 

be denoted by P F [0] I P F [1] V ...,P F [3]. 

Side information produced by the short-term predictor consists of 10 quantized reflection coefficients. 

35 Each of the coefficients is quantized with a unique non-uniform scalar codebook optimized for that coefficient. 
The short-term predictor side information is encoded by mapping the output levels of each of the 10 scalar 
code books into an unsigned binary integer. For a scalar codebook allocated B bits, the codebook entries are 
ordered from smallest to largest and an unsigned binary integer is associated with each as a codebook index. 
Hence, the integer 0 is mapped into the smallest quantizer level and the integer 2 B - 1 is mapped into the largest 

40 quantizer level. In the discussion that follows, the 10 encoded reflection coefficients will be denoted by 
rc[1] ,rc[2] ... ,rc[10]. The number of bits allocated for the quantization of each reflection coefficient are listed 
in Table 1. 
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Table 1 - Contents of the Side Information Compo- 
nent of a VMC Frame. 



5 


Quantity 


Symbol 


Bits 




Pitch Filter for Sub-frame 0 


PfIO] 


6 




Pitch Filter for Sub-frame 1 


PfIU 


6 


10 


Pitch Filter for Sub-frame 2 


PfP] 


6 




Pitch Filter for Sub-frame 3 


Pf[3] 


6 




Pitch Lag for Sub-frame 0 


PJO] 


7 


15 


Pitch Lag for Sub-frame 1 


PJH 


7 




Pitch Lag for Sub-frame 2 


PJ2] 


7 




Pitch Lag for Sub-frame 3 


PJ3] 


7 


20 


Reflection Coefficient 1 


rc[1] 


6 




Reflection Coefficient 2 


rc[2] 


6 




Reflection Coefficient 3 


rc[3] 


5 


25 


Reflection Coefficient 4 


rc[4] 


5 




Reflection Coefficient 5 


rc[5] 


4 




Reflection Coefficient 6 


rc[6] 


4 


30 


Reflection Coefficient 7 


rc[7] 


4 




Reflection Coefficient 8 


rc[8] 


4 




Reflection Coefficient 9 


rc[9] 


3 


35 


Reflection Coefficient 10 


rc[10] 


3 



Each illustrative VMC frame contains 36 bytes of excitation information that define 48 excitation vectors. 
The excitation vectors are applied to the inverse long- and short-term predictor filters to reconstruct the voice 
message. 6 bits are allocated to each excitation vector: 5 bits for the shape and 1 bit for the gain. The shape 
component is an unsigned integer with range 0 to 31 that indexes a shape codebook with 32 entries. Since a 
single bit is allocated for gain, the gain component simply specifies the algebraic sign of the excitation vector. 
A binary 0 denotes a positive algebraic sign and a binary 1 a negative algebraic sign. Each excitation vector 
is specified by a 6 bit unsigned binary number. The gain bit occupies the least significant bit location (see FIG. 
7). 

Let the sequence of excitation vectors in a frame be denoted by v[0],v[1] v[47]. The binary data gener- 
ated by the VMC encoder are packed into a sequence of bytes for transmission or storage in the order shown 
in FIG. 8. The encoded binary quantities are packed least significant bit first. 

A VMC encoded data frame is shown in FIG. 9 with the 48 bytes of binary data arranged into a sequence 
of three 4-byte words followed by twelve 3-byte words. The side information occupies the leading three 4-byte 
words (the preamble) and the excitation information occupies the remaining twelve 3-byte words (the body). 
Note that the each of the encoded side information quantities are contained in a single 4-byte word within the 
preamble (i.e., no bit fields wrap around from one word to the next). Furthermore, each of the 3-byte words 
in the body of the frame contain three encoded excitation vectors. 

Frame boundaries are delineated with synchronization headers. One extant standard message format spe- 
cif ies a synchronization header of the form: OxAA OxFF N L where N denotes an 8-bit tag (two hex characters) 
that uniquely identifies the data format and L (also an 8-bit quantity) is the length of the control field following 
the header. 

An encoded data frame for the illustrative VMC coder contains a mixture of excitation and side information, 
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and the successful decoding of a frame Is dependent on the correct Interpretation of the data contained therein. 
In the decoder, mrstracklng of frame boundaries will adversely affect any measure of speech quality and may 
render a message unintelligible. Hence, a primary objective for the synchronization protocol for use in systems 
5 embodying the present invention is to provide unambiguous identification of frame boundaries. Other objec- 
tives considered in the design are listed below; 

• 1) Maintain compatibility with existing standard. 

• 2) Minimize the overhead consumed by synchronization headers. 

• 3) Minimize the maximum time required for synchronization for a decoder starting at some random point 
10 in an encoded voice message. 

• 4) Minimize the probability of mistracking during decoding, assuming high storage media reliability and 
whatever error correction techniques are used in storage and transmission. 

• 5) Minimize the complexity of the synchronization protocol to avoid burdening the encoder or decoder 
with unecessary processing tasks. 

is Compatibility with the extant standards is important for inter-operability in applications such as voice mail 

networking. Such compatibility (for at least one widely used application) implies that overhead information 
(synchronization headers) will be injected into the stream of encoded data and that the headers will have the 
form: 

OxAA OxFF N L 

20 where N is a unique code identifying the encoding format and L is the length (in 2-byte words) of an optional 
control field. 

Insertion of one header encumbers an overhead of 4 bytes. If a header is inserted at the beginning of each 
VMC frame, the overhead increases the compressed data rate by 2.2 kB/s. The overhead rate can be mini- 
mized by inserting headers less often than every frame, but increasing the number of frames between headers 

25 will increase the time interval required for synchronization from a random point in a compressed voice message. 
Hence, a balance must be achieved between the need to minimize overhead and synchronization delay. Sim- 
ilarly, a balance must be struck between objectives (4) and (5). If headers are prohibited from occurring within 
a VMC frame, then the probability of mis-identification of a frame boundary is zero (for a voice message with 
no bit errors). However, the prohibition of headers within a data frame requires enforcement which is not always 

30 possible. Bit-manipulation strategies (e.g., bit-stuffing) consume significant processing resources and violate 
byte- boundaries creating difficulties in storing messages on disk without trailing orphan bits. Data manipulation 
strategies used in some systems alter encoded datum to preclude the random occurrence of headers. Such 
preclusion strategies prove unattractive in the VMC. The effects of perturbations in the various classes of en- 
coded data (side versus excitation information, etc.) would have to be evaluated under a variety of conditions. 

35 Furthermore, unlike SBC in which adjacent binary patterns correspond to nearest- neighbor subband excita- 
tion, no such property is exhibited by the excitation or pitch codebooks in the VMC coder. Thus it is not clear 
how to perturb a compressed datum to minimize the effect on the reconstructed speech waveform. 

With the objectives and considerations discussed above, the following synchronization header structure 
was selected for VMC: 

40 • 1) The synchronization header is OxAA OxFF 0x40 {0x00,0x01}. 

• 2) The header OxAA OxFF 0x40 0x01 is followed by a control field 2-bytes in length. A value of 0x00 0x01 
in the control field specifies a reset of the coder state. Other values of the control field are reserved for 
other particular control functions, as will occur to those skilled in the art. 

• 3) A reset header OxAA OxFF 0x40 0x01 followed by the control word 0x00 0x01 must precede a com- 
45 pressed message produced by an encoder starting from its initial (or reset) state. 

• 4) Subsequent headers of the form OxAA OxFF 0x40 0x00 must be injected between VMC frames no 
less often than at the end of every fourth frame. 

• 5) Multiple headers may be injected between VMC frames without limit, but no header may be injected 
within a VMC frame. 

50 • 6) No bit manipulations or data perturbations are performed to preclude the occurrence of a header with- 

in a VMC frame. 

Despite the lack of a prohibition of headers occurring within a VMC frame, it is essential that the header pat- 
terns (OxAA OxFF 0x40 0x00 and OxAA OxFF 0x40 0x01) can be distinguished from the beginning (first four 
bytes) of any admissible VMC frame. This is particularly important since the protocol only specifies the max- 
55 imum interval between headers and does not prohibit multiple headers from appearing between adjacent VMC 
frames. The accommodation of ambiguity in the density of headers is important in the voice mail industry where 
voice messages may be edited before transmission or storage. In a typical scenario, a subscriber may record 
a message, then rewind the message for editing and re-record over the original message beginning at some 
random point within the message. A strict specification on the injection of headers within the message would 
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either require a single header before every frame resulting in a significant overhead load or strict junctures on 
where editing may and may not begin resulting in needless additional complexity for the encoder/decoder or 
post processing of a file to adjust the header density. The frame preamble makes use of the nominal redun- 
5 dancy in the pitch lag information to preclude the occurrence of the header at the beginning of a VMC frame. 
If a compressed data frame began with the header OxAA OxFF 0x40 {0x00,0x01} then the first pitch lag PJ0] 
would have an inadmissible value of 126. Hence, a compressed data frame un corrupted by bit or framing errors 
cannot begin with the header pattern, and so the decoder can differentiate between headers and data frames. 

10 5.2 Synchronization Protocol 

In this section, the protocol necessary to synchronize VMC encoders and decoders is defined. A succinct 
description of the protocol is facilitated by the following definitions. Let the sequence of bytes in a compressed 
data stream (encoder output/decoder input) be denoted by: 
« {bj^ (49) 

where the length of the compressed message is N bytes. Note that in the state diagrams used to illustrate the 
synchronization protocol k is used as an index for the compressed byte sequence, that is k points to the next 
byte in the stream to be processed. 

The index i counts the data frames, F[i], contained in the compressed byte sequence. The byte sequence 
20 b k consists of the set of data frames F[i] punctuated by headers, denoted by H. Headers of the form OxAA 
OxFF 0x40 0x01 followed by the reset control word 0x00 0x01 are referred to as reset headers and are denoted 
by Hr. Alternate headers (OxAA OxFF 0x40 0x00) are denoted by He and are referred to as continue headers. 
The symbol Lh refers to the length in bytes of the most recent header detected in the compressed byte stream 
including the control field if present. For a reset header (Hr) Lh = 6 and for a continue header (He) Lh = 4. 
The i th data frame F[i] can be regarded as an array of 48 bytes: 

F[i] T = [b^b,,., b^ 47 ] (50) 

For convenience in describing the synchronization protocol two other working vectors will be defined. The first 
contains the next six bytes in the compressed data stream: 

V[kF = [b k ,b k + 1 ,...,b k + 5 ], (51) 
and the second contains the next 48 bytes in the compressed data stream: 

U[k]T = [b k , b k + b k + 47 ]. (52) 
The vector V[k] is a candidate for a header (including the optional control field). The logical proposition V[k] = 
H is true if the vector contains either type of header. More formally, the proposition is true if either 

V[k] T = [OxAA,OxFF,Ox40,0xO0,XX,XX], (53) 

or 

V[k] T = [0xAA,0xFF,0x40,0x01 ,0x00,0x01] (54) 
is true. Finally, the symbol I is used to denote an integer in the set {1,2,3,4}. 
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6.2.1 Synchronization Protocol—Rules for the Encoder 



For the encoder, the synchronization protocol makes few demands: 

• 1) Inject a reset header Hr at the beginning of each compressed voice message. 

• 2) Inject a continue header He at the end of every fourth compressed data frame. 

^ The encoder operation is more completely described by the state machine shown in FIG. 10. In the state dia- 
gram, the conditions that stimulate state transitions are written in Constant Width font while operations exe- 
cuted as a result of a state transition are written in Italics. 

The encoder has three states: Idle, Init and Active. A dormant encoder remains in the Idle state until in- 
structed to begin encoding. The transition from the Idle to Init states is executed on command and results in 

II IV lUIIWtfiiiy wpwi uliwi tv. 

• The encoder is reset 

• A reset header is prepended onto the compressed byte stream. 

• The frame (i) and byte stream (k) indices are initialized. 
Once in the Init state, the encoder produces the first compressed frame (F[0]). Note that in the Init state, in- 
terpolation of the reflection coefficients is inhibited since there are no precedent coefficients with which to per- 
form the average. An unconditional transition is made from the Init state to the Active state unless the encode 
operation is terminated by command. The Init to Active state transition is accompanied by the following oper- 
ations: 

• Append F[0] onto the output byte stream. 



22 



EP0 573 216 A2 



• Increment the frame index (i = i + 1). 

• Update the byte index (k = k + 48). 

The encoder remains in the Active state until instructed to return to the Idle state by command. Encoder 
5 operation in the Active state is summarized thusly: 

• Append the current frame F[i] onto the output byte stream. 

• Increment the frame index (i = i + 1). 

• Update the byte index (k = k + 48). 

• If i is divisible by 4, append a continue header He onto the output byte stream and update the byte count 
10 accordingly. 

6.2.2 Synchronization Protocol— Rules for the Decoder 

Since the decoder must detect rather than define frame boundaries, the synchronization protocol places 

15 greater demands on the decoder than the encoder. The decoder operation is controlled by the state machine 
shown in FIG. 11 . The operation of the state controller for decoding a compressed byte stream proceeds thusly. 
First, the decoder achieves synchronization by either finding a header at the beginning of the byte stream or 
by scanning through the byte stream until two headers are found separated by an integral number (between 
one and four) of compressed data frames. Once synchronization is achieved, the compressed data frames are 

20 expanded by the decoder. The state controller searches for one or more headers between each frame and if 
four frames are decoded without detecting a header, the controller presumes that sync has been lost and re- 
turns to the scan procedure for regaining synchronization. 

Decoder operation starts in the Idle state. The decoder leaves the idle state on receipt of a command to 
begin operation. The first four bytes of the compressed data stream are checked for a header. If a header is 

25 found, the decoder transitions to the Sync-1 state; otherwise, the decoder enters the Search- 1 state. The byte 
index k and the frame index i are initialized regardless of which initial transition occurs, and the decoder is reset 
on entry to the Sync-1 state regardless of the type of header detected at the beginning of the file. In normal 
operation, the compressed data stream should begin with a reset header (Hr) and hence resetting the decoder 
forces its initial state to match that of the encoder that produced the compressed message. On the other hand, 

30 if the data stream begins with a continue header (He) then the initial state of the encoder* is unobservable and 
in the absence of a priori information regarding the encoder state, a reasonable fallback is to begin decoding 
from the reset condition. 

If no header is found at the beginning of the compressed data stream, then synchronization with the data 
frames in the decoder input cannot be assured, and so the decoder seeks to achieve synchronization by lo- 

35 eating two headers in the input file separated by an integral number of compressed data frames. The decoder 
remains in the Search- 1 state until a header is detected in the input stream, this forces the transition to the 
Search-2 state. The byte counter d is cleared when this transition is made. Note that the byte count k must be 
incremented as the decoder scans through the input stream searching for the first header. In the Search-2 
state, the decoder continues to scan through the input stream until the next header is found. During the scan, 

40 the byte index k and the byte count d are incremented. When the next header is found, the byte count d is 
checked. If d is equal to 48, 96, 144 or 192, then the last two headers found in the input stream are separated 
by an integral number of data frames and synchronization is achieved. The decoder transitions from the Search- 
2 state to the Sync-1 state, resetting the decoder state and updating the byte index k. If the next header is not 
found at an admissible offset relative to the previous header, then the decoder remains in the Search-2 state 

45 resetting the byte count d and updating the byte index k. 

The decoder remains in the Sync-1 state until a data frame is detected. Note that the decoder must con- 
tinue to check for headers despite the fact that the transition into this state implies that a header was just de- 
tected since the protocol accommodates adjacent headers in the input stream. If consecutive headers are de- 
tected, the decoder remains in the Sync-1 state updating the byte index k accordingly. Once a data frame is 

£t> found, the decoder processes that frame and transitions to the Sync-2 state. When in the Sync-1 state inter- 
polation of the reflection coefficients is inhibited. In the absence of synchronization faults, the decoder should 
transition from the Idle state to the Sync-1 state to the Sync-2 state and the first frame processed with inter- 
polation inhibited corresponds to the first frame generated by the encoder also with interpolation inhibited. The 
byte index k and the frame index i are updated on this transition. 

55 A decoder in normal operation will remain in the Sync-2 state until termination of the decode operation. 

In this state, the decoder checks for headers between data frames. If a header is not detected, and if the header 
counter j is less than 4, the decoder extracts the next frame from the input stream, and updates the byte index 
k, frame index i and header counter j. if the header counter is equal to four, then a header has not been detected 
in the maximum specified interval and sync has been lost. The decoder then transitions to the Search- 1 state 
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and increments the byte index k. if a continue header is found, the decoder updates the byte index k and resets 
the header counter]. If a reset counter is detected, the decoder returns to the Sync-1 state while updating the 
byte index k. A transition from any decoder state to Idle can occur on command. These transitions were omitted 

5 from the state diagram for the sake of greater clarity. 

In normal operation, the decoder should transition from the Idle state to Sync-1 to Sync-2 and remain in 
the latter state until the decode operation is complete. However, there are practical applications in which a de- 
coder must process a compressed voice message from random point within the message. In such cases, syn- 
chronization must be achieved by locating two headers in the input stream separated by an integral number 

10 of frames. Synchronization could be achieved by locating a single header in the input file, but since the protocol 
does not preclude the occurrence of headers within a data frame, synchronization from a single header en- 
cumbers a much higher chance of mis-synchronization. Furthermore, a compressed file may be corrupted in 
storage or during transmission and hence by the decoder should continually monitor for headers to detect quick- 
ly a loss of sync fault. 

15 The illustrative embodiment described in detail should be understood to be only one application of the many 

features and techniques covered by the present invention. Likewise, many of the system elements and method 
step described will have utility (individually and in combination) aside from use in the systems and methods 
illustratively described. In particular, it should be understood that various system parameter values, such as 
sampling rate and codevector length will vary in particular applications of the present invention, as will occur 

20 to those skilled in the art. 



APPENDIX A 

REFLECTION COEFFICIENT QUANTIZER OUTPUT LEVEL TABLE 

The values in the following table represent the output levels of the 
reflection coefficient scalar quantizers for an illustrative reflection coefficient 
representable by 6 bits. 
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-0.996429443 
-0 .981475830 
-0.962249756 
-0.938140B69 
-0.905639648 
-0.862670898 
-0.809082031 
-0.736114502 
-0.640228271 
-0.493225098 
-0.273773193 
0.005310059 
0.388305664 



-0.993591309 
-0.978332520 
-0.957916260 
-0.932373047 
-0.897705078 
-0.853210449 
-0.796386719 
-0.719085693 
-0.618072510 
-0.457885742 
-0.217437744 
0.080017090 
0.481353760 



-0.990692139 
-0.974822998 
-0.953186035 
-0.925750732 
-0.889526367 
-0.843261719 
-0.781402588 
-0.701995850 
-0.588256836 
-0.418609619 
-0.166534424 
0.155456543 
0.589721680 



-0.987609863 
-0.970947266 
-0.948211670 
-0.919525146 
-0.881072998 
-0.832550049 
-0.766510010 
-0.682739258 
-0.560516357 
-0.375732422 
-0.102905273 
0.229919434 
0.735961914 



-0.984527588 
-0.966705322 
-0.943328857 
-0.912933350 
-0.872589111 
-0.820953369 
-0.751739502 
-0.661926270 
-0.526947021 
-0.328002930 
-0.048583984 
0.301239014 
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APPENDIX B 

REFLECTION COEFFICIENT QUANTIZER CELL BOUNDARY TABLE 

The values in this table represent the quantization decision thresholds 
between adjacent quantizer output levels shown in Appendix A (i.e., the boundaries 
between adjacent quantizer cells). 
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-0.995117188 
-0.9799499S1 
-0.960113525 
-0.935272217 
-0.901702881 
-0.857971191 
-0.802795410 
-0.727661133 
-0.629211426 
-0.475646973 
-0.245697021 
0.042694092 
0.435424805 



-0.992218018 
-0.976623535 
-0.955566406 
-0.929077148 
-0.893646240 
-0.848266602 
-0.788940430 
-0.710601807 
-0.603271484 
-0.438323975 
-0.192047119 
0.117828369 
0.536651611 



-0.989196777 
-0.972900391 
-0.950744629 
-0.922668457 
-0.885314941 
.837951660 
.774017334 
.692413330 
.574462891 
.397277832 
.134796143 
.192840576 
.666046143 



-0. 
-0. 
-0. 
-0. 
-0. 
-0. 

0. 

0. 



-0 .986114502 
-0.968841553 
-0.945800781 
.916259766 
.876861572 
.826812744 
.759185791 
.672393799 
-0.543823242 
-0.351989746 
-0.075775146 
0.265777588 



-0 .983032227 
-0.964508057 
-0.940765381 
-0.909332275 
-0.867675781 
-0 .815063477 
-0.743988037 
-0.651153564 
-0.510192871 
-0.300994873 
-0.021636963 
0.345153809 
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4. 



A method of processing each of a plurality of sequences of input samples comprising 

gain adjusting each of a plurality of codevectors in a backward adaptive gain controller to produce 
corresponding gain- adjusted codevectors, each of said codevectors being identified by a corresponding 
index, 

filtering each of said gain-adjusted codevectors in a synthesis filter characterized by a plurality of 
filter parameters to generate corresponding candidate codevectors, 

adjusting the parameters of said synthesis filter in response to said sequences of input samples, 
comparing successive sequences of said samples with each of said candidate codevectors, and 
outputting 

(i) the index for the candidate codevector which has the minimum difference from each of said sequenc- 
es, and 

(ii) the parameters of said synthesis filter. 

The method of claim 1 wherein 

said synthesis filter comprises a long-term filter component and a short-term filter component, 
each of said filter components being characterized by a respective plurality of filter parameters, and 

wherein adjusting the parameters of said synthesis filter comprises adjusting the parameters of 
each of said filter components based on a linear predictive analysis of said input samples. 

The method of claim 2 wherein said linear predictive analysis of said input samples comprises 

grouping a plurality of consecutive sequences of input samples into a frame of input samples, each 

of said sequences of input samples thereby comprising a sub- frame, 

determining a set of Nth order predictor coefficients corresponding to said frame of input samples. 

The method of claim 3, wherein said determining said set of nth order predictor coefficients, comprises 
performing an autocorrelation analysis of said frame of input samples to generate a set of auto- 
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correlation coefficients, and 

recursively forming said predictor coefficients based on said autocorrelation coefficients. 

5 5. The method of claim 3, further comprising 

weighting said frame of input samples to form a weighted frame of input samples prior to determin- 
ing said Nth order predictor coefficients, and 

wherein said determining said set of Nth order predictor coefficients, comprises 
performing an autocorrelation analysis of said weighted frame of input samples to generate an or- 
10 dered set of autocorrelation coefficients, and 

performing a Levin son- Durb in recursion based on said autocorrelation coefficients to determine 
said set of predictor coefficients. 
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6. The method of claim 5, further comprising 

modifying said autocorrelation coefficients to reflect the addition of a small amount of white noise. 

7. The method of claim 6, wherein said modifying comprises changing the first of said autocorrelation coef- 
ficients by a small factor. 

8. The method of claim 7, further comprising the step of modifying the bandwidth of the set of predictor coef- 
ficients, thereby expanding the spectral peaks of said synthesis filter. 



9. The method of claim 3, further comprising recursively converting said set of predictor coefficients into a 
set of reflection coefficients according to 

(form = 10, 9, 8 1) 

25 = a r 

atr-u = ~ -5P^i , i = 1, 2 m - 1 . 

1 " K, 

where, A 

30 k m is the m-th reflection coefficient and a ( T } is the i-th coefficient of the m-th order predictor. 

10. The method of claim 9, wherein each of said frames comprises S sequences of input samples, and 

said method further comprises 

weighting said frame of input samples, thereby forming weighted input samples, prior to determin- 
35 ing said nth order predictor coefficients, 

determining predictor coefficients for each weighted sub-frame of input samples based on an in- 
terpolation of predictor coefficients determined for a current frame and the predictor coefficients for the 
immediately preceding frame. 



11. The method of claim 10 wherein 

S=4, so that each of said frames comprises four sub-frames of input samples, 
said weighting is in accordance with a shaped weighting window function centered on the fourth 
of said sequences of input samples, and 

said interpolation is performed in accordance with 

v 

i - 1 m 



Mi) = (1 - £)km + £ . m = 1,2 10, and j = 1,2,3,4, 



where 



k m and are the m-th quantized reflection coefficients of the previous frame and the current 
frame, respectively, and k^Q) is the interpolated m-th reflection coefficient for the j-th weighted sequence 
of input samples. 

12. The method of claim 9, comprising the further step of quantizing said set of reflection coefficients by 
55 comparing each of said reflection coefficients with indexed elements of s threshold values identi- 

fying quantizer cell boundaries, thereby to determine an index identifying a quantizer cell, and 

based on the index identified for each reflection coefficient, assigning a quantizer output value cor- 
responding to a quantizer cell. 
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13. The method of claim 12. wherein each of said threshold values is an inverse transform value of a quantizer 
cell boundary value from a transform domain range of values. 

5 14. The method of claim 12, wherein 

said indexed elements of threshold values are stored in an ordered table of threshold values, with 
each threshold value having a uniquely associated index, and 

said comparing to determine an index value comprises searching of values in said table to find a 
value meeting a predetermined criterion. 

10 

15. The method of claim 14, wherein said searching comprises a binary tree search of said table based on 
the value of said reflection coefficients. 
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16. The method of claim 2, wherein said adjusting of the parameters of said long-term filter further comprises 

extracting a pitch lag parameter based on said linear predictive analysis of each of said sequences 
of input samples, and wherein 

said outputting parameters of said synthesis filter comprises outputting a coded representation of 
said pitch lag parameter for each sequence of input samples. 

17. The method of claim 2, wherein said adjusting of the parameter of said long-term filter further comprises 

grouping a plurality of consecutive sequences of input samples into a frame of input samples, each 
of said sequences of input samples thereby comprising a sub-frame 

extracting a pitch lag parameter for each subframe based on said linear predictive analyses of said 
subframe, and wherein 

said outputting parameters of said synthesis filter comprises outputting a coded representation of 
said pitch lag parameter and said pitch predictor tap weights for each subframe. 



18. The method of claim 17, wherein said extracting of a pitch lag parameter comprises 

generating a set of signals representing LPC residuals for the current subframe of input samples, 
forming a cross correlation, for each of a range of lag values, based on said LPC residuals for the 
30 current frame and the LPC residuals for a plurality of prior subframes, 

selecting a pitch lag parameter based on the lag value of said cross correlation having the largest 

value. 



19. The method of claim 18, wherein 
35 said LPC residuals for said current subframe and for said prior subframes are time decimated prior 

to said cross correlation, and 

said method further comprises adjusting said selected value of said lag parameter to reflect the 
time decimation. 



40 20. The method of claim 1 7, wherein said vector quantizing a plurality of pitch predictor tap weights comprises 
storing one or more pitch tap vectors corresponding to each possible set of quantized tap weights, 
determining the energy of the open-loop prediction residual for said pitch predictor tap weights, 
based on said extracted pitch lag parameter and said one or more pitch tap vectors, and 
selecting the set of quantized tap weights for which said energy is minimized. 

45 

21. The method of claim 20, wherein 

forming signals representing the transpose of a c vector, the elements of said c vector having values 
based on said LPC prediction residuals, 

said one or more pitch tap vectors comprises a y vector whose elements are products of a constant 
50 with one or more pitch tap vaiues and 

said selecting comprises selecting the set of quantized tap weights corresponding to the y vector 
which has the maximum inner product when multiplied by said transpose of said c vector. 

22. The method of claim 17, wherein 

55 said plurality of tap weights comprises three tap weights, 

said long-term filter component has a transfer function given by 
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Pi(z)= XbiZ-^ 2 " 1 . 

5 i=l 

said storing one or more pitch tap vectors corresponding to each possible set of quantized tap weights 
comprises storing a vector given by 

y = [2b 1f 2b 2l 2b 3 , -20,02, - 2b2b 3 . - 2b 3 b 1f - b* - b*. - bJF 

10 

23. The method of claim 20, wherein 

said transpose of said c vector is given by 

C t = pp(2 - p.1),*F(2 - p,2),¥(2 - p,3)^(1 t 2),^(2 f 3)^(3,1),^(1 ( 1),^(2,2),^(3,3)] , 

is where 



20 



30 



35 



V(i J) = 2d(k-p+2-i)d(k-p+2-j) l 



and d(k) are the prediction residual values. 



24. The method of claim 1 , further comprising 

removing contributions from said candidate sequences from sequences of input samples prior to 
25 said comparing. 

25. The method of claim 1, wherein said comparing comprises 

perceptually weighting said input samples and said candidate codevectors prior to said comparing. 



26. The method of claim 25, further comprising 
removing contributions from said candidate sequences from sequences of input samples prior to 

said comparing. 

27. The method of claim 1, wherein 
said plurality of codevectors comprises M/2 linearly independent codevectors, 
said M/2 codevectors are stored in a code book, with said index identifying the location of respective 

codevectors in said code book, 

said comparing comprising comparing M codevectors, said M codevectors based on said M/2 stor- 
ed codevectors and each of two sign values for said codevectors. 

40 28. The method of claim 1, wherein said backward adaptive gain controller is adaptively adjusted by the fur- 
ther step of 

passing gain information relating to said cod evector corresponding to said outputted index through 
said gain controller. 

45 29. The method of claim 1 further comprising storing said outputted index and parameters. 

30. The method of claim 1 further comprising transmitting said outputted index and parameters to a commu- 
nications medium. 

qq 31. The method of claim 1 further co rn prising 

retrieving said stored index and parameters, 

separately identifying said index and respective ones of said parameters, 
conditioning a decoder filter in accordance with said parameters, and 
applying a codevector identified by said index to said decoder filter, 
55 thereby to generate said input sequence. 
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FIG. 1 
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FIG. 3 
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FIG. 5 
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